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Abstract 

In this paper we consider the Ji — J2 — J3 classical and quantum 2D XY model. 
Spin wave calculations show that a spin liquid phase still exists in the quantum case as 
for Heisenberg models. We formulate a semiclassical approach of these models based 
on spin wave action and use a variational method to study the role played by vortices. 
Liquid and crystal phases of vortex could emerge in this description. These phases seem 
to be directly correlated with the spin liquid one and to its crystalline interpretation. 
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1 Introduction 



Low dimensional magnetic systems have been extensively studied these last years since they 
are known to exhibit non trivial quantum behaviors. This comes in particular from the 
fact that classical Heisenberg 2D anti-ferromagnets can order only at zero temperature so 
that quantum fluctuations cannot a priori be neglected. In fact, it is now well-known that 
in antiferromagnets, the quantum fluctuations can {S < ScnUcai) or cannot {S > Scruicai) 
induce a transition at T = from a Neel ordered ground state to a quantum disordered 
one, characterized by short range order [|l|. The enhancement of quantum fluctuations has 
naturally been looked for in frustrated spin systems. The combination of frustration and 
quantum fluctuations can possibly lead to a spin liquid state (for a review about spin liquid 
state see for example ref. 0). For the 2D Heisenberg model with nearest neighbor (NN) 
and next to nearest neighbors (NNN) antiferromagnetic interactions, Chandra and Dougot 
have shown by spin wave calculations that it can be disordered at T = 0. This has been 
confirmed by exact diagonalizations on a finite lattices [§,3, by series expansions 0, and 
by a renormalization group analysis of the associated non linear sigma models 0, H] . The 
latter study has shown that the couplings of the models flow under renormalization group 
transformations towards a strong coupling regime when this liquid phase is approached [||. 
Einarsson and Johannesson have shown that precisely close to this liquid state, there is 
a proliferation of tological excitations in the path integral representation of the frustrated 
Heisenberg model ||^. They have suggested from these instanton considerations possible 
realizations of this disordered liquid phase in analogy with works of Sachdev et al. [jlO| . 
In this article, we want to emphasize that there exists a system where it is likely that this re- 
lationship between topological excitations and this liquid state is much more direct, namely 
the quantum frustrated 2D XY model. We have indeed shown in a preceding paper that a 
2D classical XY model with (NN) and (NNN) interactions has a point in the (^,T) plane, 
where T^t = This result can be extended by adding a (NNNN) interaction with 

this time a whole line of Kosterlitz-Thouless transitions at T = 0, in the parameter space 
(^, ^). This line is precisely that around which, quantically, a spin liquid phase is found. 
We hypothesize in this article, that while quantum fluctuations can surely not be a priori 
neglected in this case, they are, together with vortices, responsible for a spin liquid state in 
this frustrated XY model. 



The paper is organized as follows: In section 2, we consider the classical XY model with 
competing interactions. The classical phase diagram at T = is recalled. It contains no 
spin liquid phase. Then, we pay special attention to the role played by vortices and show 
that there is a critical line where vortices are allowed at T = 0. This proves the need to 
incorporate quantum fluctuations. Indeed, in section 3, we show that linear quantum spin 
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wave computations predict a spin liquid phase (around this critical line) in the quantum 
frustrated XY model contrary to the classical model. Then, in section 4, we formulate a 
general Ginzburg-Landau- Wilson (GLW) semi-classical action from the quantum spin wave 
action in order to discuss the nature of this liquid phase. When approaching this phase, 
the spin stiffness, k{S) gets very small and we are a priori forced to take into account the 
effects of all quartic terms. We pay particular attention to the non-perturbative sector of 
this action. We find a phase where pairs of vortices can be confined at a short finite lattice 
distance. The phase described here, is some kind of liquid of vortex. This liquid state is 
favored when spin waves become softer (when n{S) — > 0) i.e. when the usual spin liquid 
phase is predicted! Finally, section 5 contains a summary of the results and some concluding 
remarks. 



2 Classical frustrated XY models 

The purpose of this section is to study the role played by vortices in classical frustrated 
XY models, especially in the weakly frustrated phase. Let us first consider the 2D classical 
Ji — J2, XY model 

H = -JiY. - ^3) + J2 cos(^fc - Oi) , (2.1) 

<i,j> «k,l» 

with Ji, J2 > and 6i the angles associated to the classical 0(2) spin Si. < , > is for nearest 
neighbors (NN) and << , >> for next to nearest neighbors (NNN). Two ground states 
are possible in the model. When |Ji| > 2J2 the ground state is ferromagnetic, whereas, 
when I Ji| < 2J2, the ground state consists of two independent diagonal sublattices with 



antiferromagnetic order |14 



From a spin wave approximation, an effective action can be derived in the ferromagnetic 
phase as 

^1 = ^ / d^x {(Ji - 2J2)(V^)2 + J2(V,V,^)2 } . (2.2) 

The classical vacuum is the standard ferromagnetic one, and therefore the term (Vx^yO)'^ 
is irrelevant according to standard perturbative arguments. In this case, the system can be 
well approximated by an XY model with an effective NN coupling constant Ji — 2J2, so that 
the action associated to a neutral pair of vortices is 

^o = 47r(Ji-2J2)log(^), (2.3) 

a 

with p the distance separating the two vortices. Therefore, there is a Kosterlitz-Thouless 
transition at the temperature Tkt = f (<^i ~ 2J2). This result can be proved more rigorously 
by a Coulomb gas treatment of the original Hamiltonian ( |2.1| ) . It has to be noticed that 
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the pairs of vortices play the role of the instantons in the non linear sigma model [T^. When 
Ji = 2 J2, TxT = 0, a result which indicates that vortex solutions are allowed in the classical 
vacuum at T = 0. This suggests that the model can have a non trivial behavior around this 
point when quantum fluctuations are considered. When Ji < 2 J2, the behavior is drastically 
different, the action ( p.2|) is somewhat meaningless in this "antiferromagnetic" phase and a 
new effective theory must be found [jlll. Nevertheless, if we suppose that the notion of pair 
of vortices still makes sense in this case, the action associated to this pair becomes negative 
so that it becomes energetically favorable to fill the vacuum with pairs of vortices. Indeed, it 
has to be noticed that the antiferromagnetic ground state defined above (for Ji < IJ2) can 
be interpreted as a lattice of vortex-antivortex (for more details, see fill]). To summarize, 
we have seen that the action associated to a pair of vortices indicates the changes in the 
classical vacuum and especially that its value equals zero at the Lifshitz point . 
This analysis can be extended when a new coupling constant J3 > 0, corresponding to a 
(NNNN) AF interaction, is added to the action (|?lD. When Ji - 2 J2 - 4J3 > 0, the classical 
vacuum is a standard ferromagnetic one. Let us consider the isotropic case (J2 = 2J3) for 
convenience, the physics along the whole line Ji — 2J2 — 4J3 = being the same [§. The 
associated action, again using a spin wave approximation, can be written as 

A = / d'x ^ {AiWey + BiV'ef } , (2.4) 

where A = (Ji — 8J3), B = J3. In the non-isotropic case, the extra-term ( J2 — 2J3)(V2,Vy6')^ 
has to be added to the action ( p. 41 ) and does not change qualitatively the results. The saddle 
point equation is 

AAe - BA'^e = , (2.5) 

with A = the Laplacian. The neutral pair of vortices is a solution of ( p.5|) and its 
associated action reads 5*0 = 47r(Ji — 8J3)log(^). There is no dependence in B, so this 
result indicates that we are in a situation similar to the previous model. Since 6*0 = at the 
critical line Ji — 2 J2 — 4 J3 = 0, vortex excitations are present at T = along the whole line 
suggesting that the quantum fluctuations have to be included. Moreover, along this line, 
quadratic terms vanish. The propagator is then governed by quartic terms and so is of short 
range orde,r favoring a disordered state at T = 0. When Ji — 2J2 — 4J3 < 0, one has to 
know which wave vector minimizes the spin wave action ( |2.4| ) in order to obtain the whole 
phase diagram. By this method, we obtain the same phase diagram at the classical level 
as for Heisenberg spins (see ||15|). This has been reported for completness in Figure 1. At 
low J3 and J2 > recover the phase with independent AF order on each sublattices 

(noted AF2) as in the Ji — J2 model. The critical line separates the ferromagnetic phase 
from two helical incommensurate phases with respective wave vectors (vr, ±Qi), (iQi, vr) 
(phase Ci) and {±Q2, ±<52) (phase C2), where Qi, Q2 are defined by cos((5i) = ^'^'^Ijf^^ and 
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cos(Q2) = (2j,+1j3) (^^^ Figure 1). 

We have seen that vortex excitations are allowed on the classical critical line Ji — 2 J2 — 4J3 = 
0. Nevertheless, no liquid phase has been found around it. Consequently, frustration is not 
sufficient at the classical level to induce a spin liquid state and quantum fluctuations must 
be included. 



3 Linear spin wave theory in quantum frustrated XY 
models 

We consider now the quantum version of these models. We just present in this section spin 
waves results that are well known for the Heisenberg model 0, but not to my knowledge 
for XY spins. The Hamiltonian can be written as 

H = Y.J.,{S:S^ + SfS]) (3.1) 

where Jij = Ji for a NN interaction, Jij = J2 for a NNN interaction and Jij = J3 for 
a NNNN interaction. The zero point fluctuations around different ordered states can be 
computed in the large S limit by different methods: a standard one with Holstein-Primakov 
bosons (see for example |]15|), and a second one with "a semi-polar" representation of spin 



operators introduced by Villain [|T6l . Both give the same results though the latter seems more 



appropriate for XY models. Let us first consider the J1 — J2, XY model (with Ji < 0, J2 > 0). 
When Ji> \J2 the ground state is ferromagnetic. The magnetization < 5*^ > reads 

<S^>=S+^--^( d-k 2 -,,-.2(2-,-) 

2 Svr^y {(2-,,-«2(2-,D)'-(%-«2r/D^}^ 

We have defined 02 = % = |[cos(A;^) + co^{ky)\ and r/^ = cos(fc^) cos(/cy). The integral 
over k runs over the first Brillouin zone [— tt, tt]^ of the two dimensional lattice. We see that 
the mean field value of is decreased by including the first corrections in ^. 
When Ji < |J2 a collinear ground state is selected by spin waves Jl^. The same kind of 



calculation can be generalized, paying attention to the anisotropy, and leads to 

2 87r2 i 2{1 - cos(A;^) co^{ky) - A2(cos(A;^) - cos(A;y))}- ' 



where ^2 = 



In Figure 2, we represent spin wave corrections as a function of J2. We can draw conclusions 
analogous to those found in the study of Heisenberg spins 0, |T^, namely linear spin wave 



theory (LSWT) predicts at any S a finite region around the Lifshitz point where the ground 
state is disordered (see Figure 2). This seems to indicate the presence of a spin liquid state. 
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Furthermore, the quantum fluctuations diverge when 0:2 = — | as 
<^"> ~ ^+ ^ -7log2(l -202) ,^2 < ^ 

<S'> ~ 5+i-7'(2a2-l)^ ,a2>^, (3.4) 
where 7 and 7' are two unimportant real numbers. 

We find asymptotic behaviors similar to Heisenberg spins. This is not in fact so surprising 
since the Lifshitz point is the same. The validity of this first order approximation compared 
to other methods like Schwinger bosons mean field theory has been discussed in ref. [|]. 
Second order spin waves calculations go along the same line and confirm the first order 
calculations (it also leads to a renormalization of the spin stiffness). Moreover, some exact 
diagonalizations on finite lattices agree qualitatively with the existence a spin liquid state 
around the Lifshitz point |^, 

A similar analysis can be performed for the Ji — J2 — J3, XY model. We are interested in the 
region around the classical critical line Ji — 2 J2 — 4 J3 = which separates the ferromagnetic 
phase from two helical phases as we have seen in section 2. The Villain method can be easily 



generalized for chiral phases ||16|. The pitch wave vector Qo.d is defined by dqjQ^^d = 
with Jq the Fourier transform associated to Jij. The spin- wave frequency and the staggered 
magnetization are in this case 



= 2, J(go)[J(go)- ^^^° + '^y^^°"'^ ] (3.5) 



1 1^2, \-JiQo) + 



2 svr^y v^j(go)[j(go)-- ^^'^°+T^^°-^^ ] 

Along the critical line k^i = Ji — 2 J2 — 4J3, the staggered magnetization has the same kind 
of divergences as in the Ji — J2 model. For example, we evaluate at the point J2 = the 
leading divergence 

< 5" >~ 5 + i -alog(Ji -4J3). (3.7) 

This behavioris similar for the whole critical line (apart from the Lifshitz point). We can 
notice that we recover directly spin wave calculations in the ferromagnetic phase by taking 
Qo = 0. It supports the fact that we can go continuously from the ferromagnetic phase to 
the chiral phases as it is already the case classically. These states have the same symmetries 
contrary to the case of the ferromagnetic and collinear phases separated by a Lifshitz point, 
and thus both states can be described by eqs. ( p.5|) , (|3^) . Since results for XY and Heisenberg 
spins are very similar at this order, it is reasonable to think that higher order corrections 
will have similar effects like a renormalization of the spin stiffness kr{S). It can be used to 
define the quantum critical line as i^r{S) = [||. Therefore, to summarize this section, we 
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have shown that spin waves predict the presence of a spin hquid phase around k,r{S) = 
generated by the combination of quantum fluctuations and frustration. 



4 A semi-classical treatment of quantum frustrated XY 
models 

In this section, we want to find an effective action able to describe the quantum behavior of 
the 2D, Ji — J2 — J3, XY model especially near the critical line. The most rigorous way to 
find an effective action for spin models is to decompose the pure spin Hamiltonian on a basis 
of coherent states, which enables a path integral description of a single spin |p, p. Another 
possibility is to formulate directly the most general effective action from the spin wave action 
and symmetry considerations. The latter strategy has been already used by Ferrer to study 
the scaling properties of the 2D Ji — J2 — J3 quantum Heisenberg model . We follow a 
similar strategy. 

In our case, we have seen from the spin wave analysis that quartic terms coming from NNN 
and NNNN interactions have to be included near the critical line since quadratic terms 
vanish on this line. Therefore, the spin waves have a propagator of the following form 
Vsw = CL k'^ + b (in the isotropic case). Following Amit et al [0, we wonder what 
physical systems could be described by a theory having the anomalous propagator fc^ + k^ 
and how it could be relevant for the understanding of the quantum phase diagram of the 2D 
Ji — J2 — J3 XY model. Therefore, we are interested in the sequelin the most general Landau- 
Ginzburg- Wilson (LGW) action for an XY-spin S", with such an anomalous propagator 

A = j d^x[A\VS\^ + B\V''S\^ + B'\SJS\^ + V{S)\ , (4.1) 
where V{S) = rol^p + AjSI"^. This effective action has a purely classical origin. Indeed, A = 



( Ji — 2J2 — 4J3), B = J3 and B' = corresponds to the classical spin wave action ( p.4|) . We 



will now make an apparently "crude " approximation, namely we suppose that the quantum 



action has a form similar to (4J) except an extra-dimension and a renormalization of coupling 
constants, such that the values given above for A, B, B' are no longer valid. Therefore, the 
quantum model takes a priori different values in the space of coupling constants. 
Nevertheless, we have an important constraint from spin wave calculations: the quantum 
critical line is always characterized by A ~ Kr{S) 0. Under the above hypothesis, this 
implies that the main differences between the classical and quantum situations rely in the 
behavior of higher derivative terms. It has to be noticed that similar effective actions have 
been derived in references [^, |] for frustrated Heisenberg models. We do not claim that 
this simple effective action contains all the physics associated with the spin liquid phase but 
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nevertheless, we will see that it can be useful to understand the role played by instantonic 
sector when the critical line corresponding to A ~ i^{S) — is approached. 
We suppose the spin S to be large and analyze phase fluctuations as it is common for XY 
spins. Therefore, we write S{r) = Soe*^^*"^ where 5*0 is spatially uniform and depends on 
the parameters of the model (see spin wave calculations). In fact, it just corresponds to the 
large S version of the Villain semi-polar representation |16|. Fluctuations around 5*0 will be 



discussed later in the article. In this case, the action ( [4. 1| ) reads 



A = Jd^x [As^ivef + Bsyiv^ey + csy{ve)^] , (4.2) 

with C = B + B'Sq. The lattice spacing a is introduced in order to have dimensionless cou- 
pling constants. The potential part has been omitted because the main effects we will study 
involve the derivative part. Normally, the operator \dp^SdpS\'^ should have been included 
in original action ( |4.1| ) but, since it gives a similar contribution as IVS*!^, it has also been 
omitted. 

To study this action, it seems useless to use perturbative arguments, because, flrst the critical 
line {A ~ k(S') 0) is characterized by a strong coupling regime [^, and second the higher 
operators are irrelevant according to the usual perturbation scheme. Because of the non 
linear term (V^)^, it is difficult to find the saddle points analytically. Nevertheless, in sec- 
tion 2, we have noticed that the action associated to a vortex-antivortex pair, characterized 
by the relative distance p, indicates the changes of the ground state when approaching the 
critical line (moreover, it is a genuine solution when C = 0). Therefore, we use a variational 
approach based on a wave function of pairs of vortices defined by 

^o = arctan^-arctan^, (4.3) 

with rl = (xi,yi), r2 = (x2,?/2) the position of both vortices (p^ = \fi — r2p). Introducing 
6*0 in (|4.2|), we have to compute 



,4,4) 



Of course, we must regularize the integrals. The lattice constant a is the most natural 
regulator in our case. The computation is made in the appendix. We obtain the following 
action for the pair of vortices 



Av{p) = 47r5| 



Ahg{P) + c(4\og{P)-^-a,^^ 
a \ a p"^ p^ 



(4.5) 



with 0:2 > a real number. When A > and C > 0, this action is minimum for p = a 
(our cut-off). Namely, we have a standard attractive increasing potential and charges tend to 



7 



form dipoles and so does not contribute. The classical situation corresponds to A = Kdas > 
C = J3 > 0, hence in the weakly frustrated region, the vortices do not contribute except 
on the classical critical line. The above conclusions are not altered in the anisotropic case. 
Nevertheless, when C/A < Co/ A < 0, the situation becomes totally different. We can see 
on Figure 3, that the potential has now a non trivial minimum pq. This corresponds to a 
liquid phase of vortices. Moreover, when C/A < Ci/A < Cq/A the action associated to the 
pair of vortices can be negative, meaning that it becomes energetically favorable to fill the 
semi-classical vacuum with pairs of vortices separated by a size po of order 2a (see Figure 
3). This result does not hardly depend on the ratio C/A. It corresponds to a crystalline 
phase of vortices. Note that the possible role of some higher order derivative terms in the 



non-perturbative sector has been already studied in lattice gauge theories in refs |jT^ where 
some rather similar conclusions have been drawn. Before commenting these results, let us 
first perform one loop calculations, in order to see the contributions of such vortex effects to 
the path integral. 

In this perspective, we use the semi-classical aproximation and expand the field 6 around 
9o as 9 = 9o + T] and keep terms at most quadratic in i] in the action (f4.1|). The partition 
function reads 

Z = Jvr]exp{-Soip))exp(^- J dx[A{Vr]y + B{V^7])'' + 2C{Vr])''{V9oY]y (4.6) 

The action in terms of 77 after integration by parts reads 

A{r]) = A7]nr] - B7]U^7] + 2Cr] [{W9ofu - {df,d''9of] r] . (4.7) 

After the gaussian integration, it remains to compute the determinant associated to the 
differential operator 

= Aa-Bn^ + 2Cn{V9o)^ - 2C(9^9^0o)^ ■ (4.8) 

Of course, it seems impossible to obtain the spectrum associated to this operator. Never- 
theless, we can use the fact that (9^9'" 6*0)^ and (V6'o)^ are ultralocal functions of r (po ~ «) 
whose asymptotic behaviors are respectively in ^ and ^. Therefore, one can approximate 
the fluctuations determinant by detfAD — -Bn^], which just corresponds to the determinant 
associated to quantum spin waves. To be more explicit, we write 

det[C] = det[V] det[l - V-\-2C{d^d''9of], (4.9) 

with V = AO — i?n^ + 2Cn(V0o)^- The second determinant can be treated perturbatively. 
Indeed, asymptotically 

,2 ^log|^-n| 



V'\-2Cid^d''9o)\f) ~ J (frr 
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and so does not contribute. A similar work can be done on V using the ultralocahty of (V^o)^ 
justifying the approximation^. In the partition function, we have now to integrate over p, 
p playing now the role of the collective coordinate |jTP|]. The only scale and translationally 
invariant measure is (Prdpp~^ ||2^. In that case, the partition function reads 



hoo 



V I ^e-^o(''UdetO(p)]^ , (4.10) 
J p'^ 





where a is the lattice cut-off. An interesting quantity often used is the ratio of the partition 
function in the unit and zero winding number. In fact, this ratio measures the weight of 
singular solutions in the path integral compared to spin waves. It will be clearly dominated 
by the tree sector, in so far as det[C(p)] ~ det[y4n — i?n]. 

The last integral defined in (|4.10| ) is carried out in the saddle point approximation around 



p = Pq. It yields 

Z = Ve-*'«) T;|,--&l-'°-)<*-;t'' Idet 0(,„)]-4 , (4.11) 

^ 

where g{A, C, po) is a positive function defined by the second derivative of the vortex action 
at p = po- By performing the gaussian integration over p, the result is 

Z = Are-^«(''«)[detO(po)27r52(?(AC7,po)]^, (4.12) 

where A is an unimportant numerical constant. This expression goes one step further that 
the vortex action ( [4.5| ). We find a competition between the exponential tree level factor 
and the fluctuation determinant representing quantum spin wave effects that are long range 
ordered. 

We are now obliged to wonder whether and when this variational approach makes sense. It 
is clear that in the weakly frustrated phase, far from the quantum critical line, spin waves 
dominate the path integral. In this region, the studies based on quantum spin wave calcula- 
tions, omitting instanton configurations, have proved to capture the essential of the infrared 
behavior |^, |^. Nevertheless, when we are close to the quantum critical line, when A 
gets very small compared to B or C, spin waves become softer and weaker and short range 
interactions (the quartic terms) are enhanced compared to spin waves. In that case, our 
variational method based on topological defects can be applied. Moreover, as it was already 
mentioned, the approach of the quantum critical line is characterized by a strong coupling 
regime where topological excitations proliferate @]. 

Let us now summarize and comment the results obtained so far. We have found that when 



■tXhe treatment of P is equivalent to solving a Schrodinger equation in a regularized attractive potential 
in There will be just a few bound states plus the continuum spectrum similar to the case C — [ p^ . 
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spin waves fall down close to the quantum critical line, there is a range of parameters in the 
action (^4.2| ) where pairs of vortices can proliferate and stabilize in a liquid phase or a crystal 
phase of vortices. It has to be noticed that the liquid phase of vortices corresponds to a 
small area in the parameter space. When C/A < Ci/A < 0, we found a crystalline phase 
where pairs of vortices are separated by a distance of order 2a (independently of the ratio 
C/A). Such a crystalline ground state is represented in Figure 4. This scenario supposes 
that in the quantum situation, there is a strong renormalization of the coupling constants 
able to change the classical behavior. This is our main hypothesis. We can not prove it, but 
such a possibility can not be ruled out a priori. Moreover, the scenario we describe seems 
a posteriori consistent with the proliferation of vortices able to induce a crystalline ground 
state discussed by Einarsson et al. . 

Before concluding, a few remarks are in order. In our analysis, the higher order term (V6')^ 



plays an important role. Amit et al |]T3[ have already wondered about the role of such 
"dangerous irrelevant operators" (see also ref. 01). In our study, we have shown that 
its importance relies essentially in the non-perturbative sector. In the usual perturbation 
scheme, power counting arguments eliminate this kind of operators because they are irrel- 
evant in the infrared limit. Nevertheless, the spin liquid phase is characterized by a strong 
coupling regime where renormalization group technics fail. So, usual arguments used to 
eliminate such operators can not be applied here. Near the critical line, the semi-classical 
vacuum becomes disordered and dominated by short range order operators (higher gradient 
ones). In that case, it is not so surprising that such an operator can play a role. For more 



justifications, we refer the reader to ref where this question is largely adressed. 
In our analysis, the operator (V6')^ has emerged because we have decomposed S{x) = Sqc''^^^^ 
If we consider amplitude fluctuations, namely if we write S{x) = {Sq + A5''(x))e*^*^^^ and in- 
tegrate out the fluctuations of the order parameter ( in a potential) we would generate series 
of operators like {dfj_SduS)"' as described in p2|. We hope that these higher corrections do 
not change qualitatively the physics presented in this section. Moreover, we will always find 
a range of parameters where the scenario we have described should apply. 



5 Conclusion 



In this paper, we have studied the 2D classical and quantum Ji — J2 — J3, XY model on 
a square lattice. We have first shown that there is a classical critical line where vortices 
are present even at T = 0. It justifies why quantum fluctuations have to be included near 
this critical line. Quantum spin wave calculations predicts a spin liquid phase around this 
critical line. To study the role played by vortices when approaching this spin hquid phase, we 
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have considered a general GLW action deduced from spin wave calculations. We have found 
non-perturbatively a range of parameters where a crystal phase of vortices can take place 
around this critical line. This phase seems to be directly correlated with the spin liquid phase 
predicted by spin waves calculations. It is difficult to compare this crystalline phase with 



the possible disordered ground states of Heisenberg spins proposed by sachdev et al. |jTO| 
except that both descriptions have a short range crystalline order. Yet, this study has the 
advantage to show qualitatively how a non trivial liquid phase can emerge non perturbatively 
in two dimensions at T = 0. It should be very interesting to investigate numerically this 
model. To test the validity of the scenario described in this paper, a possibility could be to 
look at the nature of the transition between the spin liquid phase and the chiral phases. It 



may correspond to a melting of this crystal of vortex phase as in ref. |^3[ , induced by chiral 
spin waves. In that case, the transition could be of KT type. 

Finally, this analysis suggests that we may build classical spin models that can also be 
described by an effective action similar to ([4.1|) . Such spin models would include multibody 
interactions. A general study of 3D classical spin systems without long-range order has been 
done by Alcaraz et al (p4[ and references therein). They have done a general classification 



of these spin systems from symmetry considerations. This kind of models (especially their 
strange symmetry) could be useful to the description of certain aspects of disordered phases 
23] in statistical systems. The link between such classical models and spin liquid phases is 



not clear and will be the subject of future work. 
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Appendix. 

In this appendix, we give the main steps of the computation of the integral ( [4.4| ). We 
place one vortex charge at the center 0(0,0) and the other in y4(p, 0). In polar coordinate. 



the integral / (|4.4| ) reads 



rdrdO- ^ 



jA(j.2 _j_ p2 _ 2rpcos{6)y 
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The integration of this rational function over r gives 



I = 27ra' 



+2 



7 1 



7 



8p(r + p) 8(r + 



8p(r — p) 8(r — p)^ 



sign{r^ — p^) 



+ 0O 



{A2) 



The contribution at r = and r = p must be taken with our lattice regularization. We 
finally obtain 



/ = 47ra2 



41og(^) a 



{A3) 



p- p- 

with a = 2 log 2 + ^. Notice that with this method, we recover the known result of 
/ (ia;(V^o)^ = 47rlog(-) ( where represents a pair of vortices separated by a distance 
P)- 
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FIGURE CAPTIONS 



FIG.l The classical phase diagram for the Ji — J2 — J3 XY model on a square lattice. F 
corresponds to a ferromagnetic ground state, AF2 to two decoupled sublattices with inde- 
pendent AF order and Ci, C2 two incomensurate chiral phases. 



FIG. 2 First quantum corrections to the lattice magnetization in the Ji — J2 XY model. 
The 0{1/S) spin wave theory predicts an intermediary region where the ground state is 
non-magnetic and thus can be a spin liquid phase. 



FIG. 3 The action associated to a pair of vortex separated by a distance p. Three cases 
have been represented: a positive action without any extremum, a positive action with a 
minimum in p = po and a negative action with a similar minimum around p = 2a. 



FIG. 4 A schematic representation of a lattice crystal of vortex separated by p = 2a. 
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